IMAGE INTERPOLATING DEVICE 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image interpolating 
device provided in a digital camera, for example, to improve color 
image quality. 

2. Description of the Related Art 

Conventionally, there is known a digital camera in which 
a color filter of the Bayer arrangement is provided on a light 
receiving surface of an imaging device such as a CCD so as to sense 
a color image. The color filter is formed by arranging red(R) , 
green (G), and blue (B) color filter elements in a checkerboard 
arrangement, and the color filter elements correspond to 
photodiodes of the imaging device. Therefore, a pixel signal of 
a color, which corresponds to each of the color filter elements, 
is generated by each of the photodiodes . For example, an R pixel 
signal is generated by a photodiode corresponding to an R color 
filter element. 

A pixel signal maybe subjected to an interpolating process 
so that a color image having a higher quality is obtained, in 
comparison with the case in which a pixel signal output from the 
imaging device is used just as it is. In a usual interpolating 
process, regarding an objective pixel from which an R-signal is 
obtained by a photodiode, a G-signal is generated by taking an 



average of the G-signals of pixels positioned around the objective 
pixel, and a B-signal is generated by taking an average of the 
B-signals of pixels positioned around the objective pixel. 
However, for example, in an image in which spatial frequency is 
5 high, the actual color of the objective pixel, for which a color 
is to be obtained by interpolation, may be largely different from 
the actual colors of the pixels around the objective pixel. In 
such a case, chromatic blur occurs because of the color signal 
of the pixel obtained by interpolation. 
C3 10 SUMMARY OF THE INVENTION 

o 

Jj Therefore, an object of the present invention is to reduce 

the chromatic blur which occurs in a reproduced image because of 

li 

the interpolating process. 

13 

jM; According to the present invention, there is provided an 

fU 

ry 15 image interpolating device comprising a color filter, an imaging 

o 

FlJ device, apattern-settingprocessor , a G-interpolation processor , 

an R/B-interpolation processor, a first 

interpolation/modification processor, and a second 
interpolation/modification processor . 
20 The color filter has a firs trow, in which red (R) and green (G) 

color filter elements are alternately aligned in the horizontal 
direction, and a second row, in which G and blue(B) color filter 
elements are alternately aligned in the horizontal direction . The 
second row is adjacent to the upper or lower side of the first 
25 row. The imaging device generates first R, G, and B-signals which 



are pixel signals corresponding to the color filter elements . The 
pattern-setting processor extracts images belonging to a first 
pattern, in which a pixel having the first R-signal is positioned 
at the upper-left corner of a 2 x 2 pixel matrix, a second pattern, 
5 in which a pixel having the first G-signal is positioned at the 
upper-right corner of the 2x2 pixel matrix, a third pattern, 
in which a pixel having the first G-signal is positioned at the 
lower-left corner of the 2x2 pixel matrix, and a fourth pattern, 
in which a pixel having the first B-signal is positioned at the 

H 

p 10 lower-right corner of the 2x2 pixel matrix, from the first R, 

Q 

Mi G, and B-signals generated by the imaging device. The 

O 

G- interpolation processor, regarding first and fourth objective 

il 

pixels contained in the images belonging to the first and fourth 

II patterns, obtains a second G-signal by utilizing the first 

fU 

ly 15 G-signals of pixels adjacent to the first or fourth objective pixel . 

O 

III The R/B-interpolation processor, regarding second and third 
objective pixels contained in the images belonging to the second 
and third patterns, obtains second R and B-signals by utilizing 
the first R and B-signals of pixels adjacent to the second and 

20 third objective pixels. The first interpolation /modification 
processor extracts a first similar pixel which has the closest 
luminance value to that of the first objective pixel, from pixels 
adjacent to the first objective pixel, obtains a third B-signal 
of the first objective pixel by a first interpolation process, 

25 and modifies the second G-signal of the first objective pixel, 
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based on first information of the first similar pixel . The second 
interpolation/modification processor extracts a second similar 
pixel which has the closest luminance value to that of the fourth 
objective pixel , from pixels adjacent to the fourth obj ective pixel , 
obtains a third R-signal of the fourth objective pixel by a second 
interpolation process, and modifies the second G-signal of the 
fourth objective pixel, based on second information of the second 
similar pixel . 

Further, according to the present invention, there is 
provided an image interpolating device comprising an imaging device , 
an interpolation processor, and a modification processor. 

The imaging device has a light receiving surface on which 
pixels are disposed in a matrix arrangement. A subject image is 
formed on the light receiving surface to generate first color 
signals corresponding to the subject image in the pixels. The 
interpolation processor performs an interpolation process, using 
the first color signals generated in a plurality of ad j acent pixel s 
positioned adjacent to an objective pixel , to obtain a second color 
signal of the objective pixel. The modification processor 
extracts a similar pixel which has the closest luminance value 
to that of the obj ective pixel , from pixels adjacent to the obj ective 
pixel, and modifies the second color signal of the obj ective pixel, 
based on a luminance value and color difference signals Cb and 
Cr of the similar pixel , or based on a color signal of the objective 
pixel and color difference signals Cb and Cr of the similar pixel . 



BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present invention will 
be better understood from the following description, with 
reference to the accompanying drawings in which: 
5 Fig. 1 is a block diagram showing a general structure of 

a digital camera provided with an image interpolating device to 
which a first embodiment of the present invention is applied; 

Fig. 2 is a view showing an arrangement of color filter 
elements of a color filter, and pixel signals of an image belonging 
□ 10 to a pattern extracted in a pattern-setting unit; 

q 

iFI Fig. 3 is a view showing coordinates and colors of pixels 

™ forming an image; 

Fig. 4 is a flowchart of a G-interpolation process routine; 

P 

m Fig. 5 is a flowchart of an R/B- interpolation process 

ru 

TQ 15 routine ; 

O 

fy Fig. 6 is a view showing pixel signals obtained by executing 

the G-interpolation process routine and the R/B-interpolation 
process routine ; 

Figs. 7A and 7B show a flowchart of a first 
20 interpolation/modification process routine; 

Fig. 8 is the latter part of a flowchart of a second 
interpolation/modification process routine; 

Fig. 9 is the initial part of a flowchart of the first 
interpolation/modification process routine of a second 
25 embodiment ; 
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Fig. 10 is the initial part of a flowchart of the second 
interpolation/modification process routine of the second 
embodiment ; 

Fig. 11 is the latter part of a flowchart of the first 
5 interpolation/modification process of a third embodiment; and 
Fig. 12 is the latter part of a flowchart of the second 
interpolation/modification process routine of the third 
embodiment . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

H 

O 10 The present invention will be described below with 

9 

In reference to embodiments shown in the drawings . 

q 

% J Fig. 1 is a block diagram showing a general structure of 

a digital camera 10 provided with an image interpolating device 
M; to which a first embodiment of the present invention is applied. 

ru 

fy 15 A CCD 12, which is an imaging device, is disposed behind 

a 

ru a photographing lens 11, and a color filter 13 is provided on a 

light receiving surface of the CCD 12. Namely, an optical image 
of a subject S, which is obtained by the photographing lens 11, 
is formed on the light receiving surface of the CCD 12 , so that 
20 color pixel signals forming the subject image are generated on 
photodiodes of the CCD 12 . The pixel signals are read from the 
CCD 12, and are converted to digital signals by an A/D converter 
14. The digital pixel signals are subjected to a white balance 
adjustment in a white balance adjusting circuit 15, and are then 
25 stored in an image memory 16. 
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The pixel signals are read from the image memory 16, and 
input to a pattern-setting unit 17 . As will be described in detail 
later, in the pattern-setting unit 17, pixel signals forming a 
predetermined arrangement pattern are extracted from all the pixel 
5 signals, and are classified into first, second, third, and fourth 
patterns. In an interpolation process unit 18, the pixel signals 
extracted in the pattern-setting unit 17 are subjected to an 
interpolating process corresponding to the pattern. The pixel 
signals, which have been subjected to the interpolating process 

O 10 and output from the interpolation process unit 18, are recorded 

Q 

y § in a recording medium D, such as a memory card. Note that the 

O 

:. ft 

;g white balance adjusting circuit 15 does not have to be provided 

\ behind the A/D converter 14 , and it can be behind the interpolation 

fl 

%A process unit 18. 

ffj 15 Fig. 2 is a view showing an arrangement of color filter 

P 

lU elements of the color filter 13, and pixel signals of an image 

belonging to a pattern extracted in the pattern-setting unit 17. 
The color filter 13 is composed of red(R) , green (G) , and blue (B) 
color filter elements, which are disposed in accordance with the 

20 Bayer arrangement. Namely, the color filter 13 is composed of 
a first row 13a, in which R and G color filter elements are 
alternately aligned in the horizontal direction , and a second row, 
which is adjacent to the upper or lower side of the first row 13a, 
and in which G and B color filter elements are alternately aligned 

25 in the horizontal direction. In the CCD 12, first R, G, and 
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B-signals, which are pixel signals corresponding to the color 
filter elements, are generated. 

The color filter 13 is divided into a 2 x 2 pixel matrix 
Ml in which an Rcolor filter element is positioned at the upper-left 
5 corner, a G color filter element is positioned at both the 
upper-right corner and the lower-left corner, and a B color filter 
element is positioned at the lower-right corner. The 
pattern-setting unit 17 extracts images belonging to a first 
pattern, in which a pixel having the first R-signal is positioned 

h 10 at the upper-left corner of the 2x2 pixel matrix, a second pattern, 

O 

W in which a pixel having the first G-signal is positioned at the 

l *2 upper-right corner of the 2x2 pixel matrix, a third pattern, 

in which a pixel having the first G-signal is positioned at the 
12 lower-left corner of the 2x2 pixel matrix, and a fourth pattern, 

ru 

rij 15 in which a pixel having the first B-signal is positioned at the 

O 

rU lower-right corner of the 2x2 pixel matrix, from the first R, 

G, and B-signals generated by the CCD 12. 

In the pattern-setting unit 17, the first pattern is 
extracted from all of the pixel signals forming the whole image, 

20 according to the logical operation (1) described in C language. 
! (x%2) && » <y%2) (1) 
Note that, in the logical operation (1) , "x" and "y" respectively 
indicate an abscissa and an ordinate in which the upper-left corner 
of the image is the origin (0,0) . Namely, the coordinate of the 

25 R-signal of the left corner is (0,0) , and the coordinate of the 
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G-signal of the next pixel on the right side is (1,0) . Further, 
in the logical operation (1) , " ! " indicates the logical negation, 
and "%" indicates the residue, and "&&" indicates the logical 
product. Therefore, according to the logical operation (1) , an 
5 image composed of a pixel, in which both the x-ordinate and the 
y-ordinate are even numbers, is extracted (R-signal in Fig. 2) . 

Similarly, the second pattern, the third pattern, and the 
fourth pattern are respectively extracted according to the logical 
operations (2) , (3) , and (4) . 

Q 10 (x%2) && ! (y%2) (2) 

O 

15 ! (x%2) && (y%2) (3) 

lJ 

jj (x%2) && <y%2) (4) 

With reference to Figs. 3 through 8, an operation in the 

ip 

H interpolation process unit 18 will be described below. Fig. 3 

ry 

'y 15 shows coordinates and colors of pixels forming an image, which 
* y are stored in the image memory 16. In the interpolation process 

unit 18, as will be described later, the G- interpolation process 
routine (Fig. 4) , the R/B-interpolation process routine (Fig. 5) , 
the first interpolation/modification process routine (Figs. 7A, 
20 7B) , and the second interpolation/modification process routine 
(Fig. 8) are executed. In these interpolation process routines, 
the . coordinates of the objective pixel, obtained by the 
interpolation process, are (x,y) . 

Fig. 4 is a flowchart of the G- interpolation process routine . 
25 In the G-interpolation process routine, an interpolation process 
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for images belonging to the first and fourth patterns is performed. 

In Step 101, it is determined whether the absolute value 
of the difference between G<x-l,y) and G(x+l,y) is less than the 
absolute value of the difference between G(x,y-1) and G(x,y+1) . 
G(x-l,y) is a first G-signal of a pixel adjacent to the left side 
of the objective pixel. G(x+l,y) is a first G-signal of a pixel 
adjacent to the right side of the objective pixel. G(x,y-1) is 
a first G-signal of a pixel adjacent to the upper side of the 
objective pixel . G(x,y+1) is a first G-signal of a pixel adjacent 
to the lower side of the objective pixel. When the coordinates 
of the objective pixel are (2,2) , for example, i.e. , in the case 
of an image of the first pattern, the objective pixel is R(2,2) , 
and in Step 101, it is determined whether | (Gl , 2) -G (3 , 2) lis less 
than | (G2,l)-G(2 / 3) | . 

Note that, when the objective pixel is contained in an image 
belonging to the first pattern, i.e. , in the case of an R-signal, 
the pixels adjacent to the right and left sides are contained in 
an image belonging to the second pattern, and the pixels adjacent 
to the upper and lower sides are contained in an image belonging 
to the third pattern. On the other hand, when the objective pixel 
is contained in an image belonging to the fourth pattern, i.e. , 
in the case of a B-signal, the pixels adjacent to the right and 
left sides are contained in an image belonging to the third pattern , 
and the pixels adjacent to the upper and lower sides are contained 
in an image belonging to the second pattern. 
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When it is determined in Step 101 that the absolute value 
of the difference between the pixel signals adjacent to the right 
and left sides of the objective pixel is less than the absolute 
value of the difference between the pixel signals adjacent to the 
5 upper and lower sides of the objective pixel, Step 102 is executed 
in which an arithmetic mean of G(x-l,y) and G(x+l,y) , which are 
pixel signals adjacent to the right and left sides, is obtained 
as a second G-signal g of the objective pixel. Conversely, when 
it is determined that the absolute value of the difference between 

d 10 the pixel signals adjacent to the right and left sides of the 

O' 

ifj objective pixel is not less than the absolute value of thedif f erence 

between the pixel signals adjacent to the upper and lower sides 

I of the objective pixel , Step 103 is executed in which an arithmetic 

Q 

Li mean of G(x,y-1) and G(x,y+1) , which are pixel signals adjacent 

ru 

flj 15 to the upper and lower sides, is obtained as a second G-signal 

O 

g of the objective pixel . After the execution of Step 102 or 103, 
the G- interpolation process ends. 

Thus, in the G-interpolation process routine, regarding each 
of the pixel s in the images belonging to the first and four th patterns , 

20 an arithmetic mean of the two first G-signals of a pair, in which 
the difference is less than that of another pair, is obtained as 
the second G-signal . When the G-interpolation process routine 
has been executed for all of the pixels of the images belonging 
to the first and fourth patterns , the G-signals of all of the pixels 

25 forming the whole image have been obtained. 
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Fig. 5 is a flowchart of the R/B-interpolation process 
routine. In the R/B-interpolation process routine, an 
interpolation process for images belonging to the second and third 
patterns is performed. Pixels utilized in the R/B-interpolation 
5 process routine are contained in the images belonging to the first 
and fourth patterns . 

In Step 201, it is determined whether the objective pixel 
is contained in an image belonging to the second pattern. When 
the objective pixel is contained in the second pattern, i.e., when 

I* 

O 10 the objective pixel is a first G-signal , which is positioned at 

O 

IH the upper-right corner of the pixel matrix Ml (Fig. 2) , Step 202 

is executed. Conversely, when the objective pixel is notcontained 

g in the second pattern, i.e., when the objective pixel is contained 

p 

\a in the third pattern, and is a first G-signal which is positioned 

ru 

fU 15 at the lower-left corner of the pixel matrix Ml (Fig. 2) , Step 

o 

TU 203 is executed. 

In Step 202, an arithmetic mean of R(x-l,y) and R(x+l,y) , 
which are pixel signals adjacent to the right and left sides of 
the objective pixel (i.e., an image of the first pattern), is 
20 obtained as a second R-signal r of the objective pixel. Further, 
an arithmetic mean of B(x,y-1) andB(x,y+l) , which are pixel signals 
adjacent to the upper and lower sides of the objective pixel (i.e. , 
an image of the fourth pattern) , is obtained as a second B-signal 
b of the ob j ecti ve pixel . 
25 In Step 203, an arithmetic mean of R(x,y-1) and R(x,y+1) , 



which are pixel signals adjacent to the upper and lower sides of 
the objective pixel (i.e., an image of the first pattern), is 
obtained as a second R-signal r of the objective pixel. Further, 
an arithmetic mean of B(x-l,y) andB(x+l,y) , which are pixel signals 
5 adjacent to the right and left sides of the objective pixel (i.e., 
an image of the fourth pattern) , is obtained as a second B-signal 
b of the ob j ecti ve pixel . 

After the execution of Step 202 or 203 , the R/B-interpolation 
process ends. Thus, in the R/B-interpolation process routine, 

I- 

rj 10 regarding each of the pixels in the images belonging to the second 

o 

ifl and third patterns , the pixel signals adjacent to the right, left, 

%y upper, and lower sides are interpolated, so that the second R, 

and B-signal s are obtained. When the G-interpolation process 
12 routine (Fig. 4) has been executed and the R/B-interpolation 

fij 15 process routine has been executed for all of the pixels of the 

a 

fU images belonging to the second and third patterns, the G-signals 

are obtained for all of the pixels forming the whole image, and 
the second R-signals r and the second B-signals b are obtained 
for each of the pixels of the images belonging to the second and 

20 third patterns , as understood from Fig. 6. Namely, regarding the 
image belonging to the first pattern, B-signals have not been 
obtained yet, and regarding the image belonging to the fourth 
pattern, R-signals have not been obtained yet. 

Figs. 7A and 7B show a flowchart of the first 

25 interpolation/modification process routine, by which third 
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B-signals are obtained for the pixels of the image belonging to 
the first pattern, and the second G-signal obtained by the 
G-interpolation process routine (Fig. 4) is modified. Pixels 
utilized in the first interpolation/modification process routine 
are contained in the images belonging to the second and third 
patterns, respectively. 

In Step 301, it is determined whether the absolute value 
of the difference between G(x-l,y) and G(x,y) is less than the 
absolute value of the difference between G(x+l,y) and G(x,y) . 
G(x-l,y) is a first G-signal of a pixel adjacent to the left side 
of the objective pixel. G(x+l,y) is a first G-signal of a pixel 
adjacent to the right side of the objective pixel. G(x,y) is a 
second G-signal of the objective pixel. Thus, it is determined 
which first G-signal of a pixel, adjacent to the right or left 
side of the objective pixel, has the closer value to that of the 
second G-signal of the objective pixel. When the first G-signal 
of a pixel adjacent to the left side is closer to the second G-signal 
of the objective pixel, Step 302 is executed in which a parameter 
p is set to -1. Conversely, when the first G-signal of a pixel 
adjacent to the right side is closer to the second G-signal of 
the objective pixel , or when the absolute value of the difference 
between the first G-signal of a pixel adjacent to the left side 
and the second G-signal of the objective pixel is equal to the 
absolute value of the difference between the first G-signal of 
a pixel adjacent to the right side and the second G-signal of the 
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objective pixel, Step 303 is executed in which the parameter p 
is set to 1. 

In Step 304, it is determined whether the absolute value 
of the difference between G(x,y-1) and G(x,y) is less than the 
5 absolute value of the difference between G(x,y+1) and G(x,y) . 
G(x,y-1) is a first G-signal of a pixel adjacent to the upper side 
of the objective pixel. G(x,y+1) is a first G-signal of a pixel 
adjacent to the lower side of the objective pixel. Thus, it is 
determined which first G-signal of a pixel, adjacent to the upper 
O io or lower side of the objective pixel, has the closer value to that 
^ of the second G-signal of the objective pixel. When the first 

o 

G-signal of a pixel adjacent to the upper side is closer to the 

, second G-signal of the objective pixel, Step 305 is executed in 

O 

which a parameter q is set to -1. Conversely, when the first 

ry 

til 15 G-signal of a pixel adjacent to the lower side is closer to the 

o 

W second G-signal of the objective pixel , or when the absolute value 

of the difference between the first G-signal of a pixel adjacent 
to the upper side and the second G-signal of the objective pixel 
is equal to the absolute value of the difference between the first 
20 G-signal of a pixel adjacent to the lower side and the second G-signal 
of the objective pixel , Step 306 is executed in which the parameter 
q is set to 1. 

In Step 307, the values of the G-signals are compared 
regarding a pixel adjacent to the right or left side of the objective 
25 pixel , a pixel adjacent to the upper or lower side of the objective 
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pixel, and the objective pixel. When the first G-signal of the 
pixel on the left side is closer to the second G-signal of the 
objective pixel in comparison with the first G-signal on the right 
side, and the first G-signal of the pixel on the upper side is 
closer to the second G-signal of the objective pixel in comparison 
with the first G-signal of thepixel on the lower side , the parameters 
p and q are -1, and it is determined whether an absolute value 
of the difference between G(x-l,y) and G(x,y) is less than an 
absolute value of the difference between G(x,y-1 ) andG(x,y) . When 
the first G-signal of the left side is closer to the second G-signal 
of the objective signal , Step 308 is executed in which a parameter 
s is set to p, i.e. , -1. Conversely, when the first G-signal of 
the upper side is closer or equal to the second G-signal of the 
objective signal, or when the absolute value of the difference 
between the first G-signal of a pixel adjacent to the left side 
and the second G-signal of the objective pixel is equal to the 
absolute value of the difference between the first G-signal of 
a pixel adjacent to the upper side and the second G-signal of the 
objective pixel, Step 309 is executed in which the parameter s 
is set to 2 x q, i.e., -2. 

When both of the parameters p and q are 1 , when the parameters 
p and q are -1 and 1, or when the parameters p and q are 1 and 
-1, Step 307 and Step 308 or 309 are executed in a similar way 
as the above. Thus, in the first interpolation/modifi cation 
process routine, regarding the second G-signal of the objective 
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pixel, the values of the first G-signals of the pixels, which are 
contained in the second and third patterns and positioned adjacent 
to the objective pixel, are checked. As a result, if the first 
G-signal of the pixel adjacent to the left side is the closest 
5 to the second G-signal of the objective pixel, the parameter s 
is set to -1. If the first G-signal of the pixel adjacent to the 
right side is the closest, the parameter s is set to 1 , if the 
f i r s t G- s i gnal of the pixel ad j acent to the upper side i s the closes t , 
the parameter s is set to -2, and if the first G-signal of the 
10 pixel adjacent to the lower side is the closest, the parameter 

o 

Iff s is set to 2 . 

%3 In this specification, among the adjacent four pixels, the 

^ pixel having the first G-signal, which is determined in the first 

rf interpolation/modification process routine to have the closest 

Fii 

pi 15 value to the second G-signal of the objective pixel, is referred 

6 

fy to as a first similar pixel. Preferably, the pixel having the 

closest luminance value to that of the objective pixel is selected 
as the first similar pixel. However, the luminance value of the 
objective pixel is unknown. Therefore, the luminance value is 

20 presumed using the G-signal, so that the first similar pixel is 
extracted, as described above. 

In Step 310, it is determined whether the parameter s is 
-1, i.e. , whether the first similar pixel is adjacent to the left 
side of the objective pixel. When the parameter s is -1, Step 

25 311 is executed in which a luminance value Y, color difference 
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signals Cb and Cr, and a modified luminance value YG are obtained 
using R(x-l,y) , G(x-l,y) , and B(x-l,y) which are the second R, 
first G, and second B-signals of the first similar pixel. 

The luminance value Y , the color difference signals Cb and 
5 Cr, and the modified luminance value YG are calculated according 
to the following formulas (5) , (6) , (7) , and (8) . 
Y=0.299 x R(x-l,y)+0.587 x G (x-1 ,y) +0 . 114 x B(x-l,y) (5) 
Cb=-0.169 x R(x-l,y)-0.331 x G(x-l / y)+0.5 x B(x-l,y) (6) 
Cr=0.5 x R(x-l,y) -0.419 x G (x-1 ,y) -0 . 081 x B(x-l,y) (7) 

10 YG=Y x G(x,y) /G(x-l,y) (8) 

The formulas (5), (6), and (7) are known. The modified 
luminance value YG is obtained by multiplying the luminance value 
Y by a ratio of the second G-signal of the objective pixel and 
the first G-signal of the first similar pixel, as understood from 

15 the formula (8) . 

In Step 312, the second G-signal of the objective pixel is 
calculated or modified according to the formula (9) , so that a 
modified G-signal g' is obtained. Further, a third B-signal of 
the objective signal is calculated according to the formula (10) , 

20 which is equivalent to an interpolation process . Thus, the first 
interpolation/modification process routine ends. 
g'=YG-0.344 x Cb-0.714 x Cr (9) 
b=YG+1.772 x Cb (10) 
Note that the formula (10) is obtained by defining the color 

25 difference signals Cb and Cr as Cb=(B-Y) x 0.5/(1-0.114) and 
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Cr=(R-Y) x 0.5/(1-0.299), and by transforming these definition 
formulas while substituting the modified luminance value YG for 
the luminance value Y. The formula (9) is obtained by defining 
the luminance value Y as Y=0.299 x R+0.587 x G+0.114 x B, and by 
5 transforming this definition formula and the definition formulas 
of the color difference signals Cb and Cr while substituting the 
modified luminance value YG for the luminance value Y. 

Thus, in the first embodiment, the third B-signal of the 
objective pixel is obtained by interpolation, and the second 

O 10 G-signal is modified, supposing that the color difference signals 

S 

y.j Cb and Cr of the objective pixel are equal to the color difference 
signals Cb and Cr of the first similar pixel , and deeming the modified 

\& 

_ luminance value YG to be the luminance value of the objective pixel . 

M= When it is determined in Step 310 that the parameter s is 

ru 

fU 15 not -1, the process goes to Step 313 in which it is determined 

O 

fU whether the parameter s is 1 , i.e., whether the first similar pixel 

is adjacent to the right side of the objective pixel. When the 
parameter s is 1, Step 314 is executed in which a luminance value 
Y, color difference signals Cb and Cr, and a modified luminance 
20 value YG are obtained using the second R, first G, and second 
B-signals of the first similar pixel . 

The luminance value Y, the color difference signals Cb and 
Cr, and the modified luminance value YG are calculated according 
to the following formulas (5a) , (6a) , (7a) , and (8a) . 
25 Y=0.299 x R(x+l,y)+0.587 x G (x+1 ,y) +0 . 114 x B(x+l,y) (5a) 
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Cb=-0.169 x R(x+l,y) -0.331 x G(x+l,y)+0.5 x B(x+l,y) (6a) 
Cr=0.5 x R(x+l,y) -0.419 x G (x+1 , y) -0 . 081 x B(x+l,y) (7a) 
YG=Y x G(x,y)/G(x+l,y) (8a) 

Step 312 is then executed. Namely, the second G-signal of 
5 the objective pixel is modified according to the formula (9) , so 
that a modified G-signal g' is obtained. Further, a thirdB-signal 
of the objective signal is calculated according to the formula 
(10) . Thus, the first interpolation/modification process routine 
ends . 

M 

p 10 When it is determined in Step 313 that the parameter s is 

O 

til not 1 , the process goes to Step 315 in which it is determined whether 

the parameter s is -2, i.e., whether the first similar pixel is 
adjacent to the upper side of the objective pixel. When the 
|T parameter s is -2, Step 316 is executed in which a luminance value 

ru 

ry 15 Y, color difference signals Cb and Cr, and a modified luminance 

Q ■ 

fll value YG are obtained using the second R, first G, and second 

B-signals of the first similar pixel. 

The luminance value Y, the color difference signals Cb and 
Cr, and the modified luminance value YG are calculated according 
20 to the following formulas (5b) , (6b) , (7b) , and (8b) . 

Y=0.299 x R(x,y-l)+0.587 x G (x,y-l) +0 . 114 x B(x,y-1) (5b) 
Cb=-0. 169 x R(x,y-1) -0.331 x G(x,y-l)+0.5 x B(x,y-1) (6b) 
Cr=0.5 x R(x,y-1)-0.419 x G (x, y-1) -0 . 081 x B(x,y-1) (7b) 
YG=Y x G(x,y) /G(x,y-1) (8b) 
25 Then, in ways similar to those in Steps 311 and 314, Step 

20 



312 is executed in which the second G-signal of the objective pixel 
is modified according to formula (9) , a third B-signal of the 
objective pixel is calculated according to the formula (10) , and 
the first interpolation/modification process routine ends. 

When it is determined in Step 315 that the parameter s is 
not -2, it is deemed that the parameter is 2, i.e. , it is deemed 
that the first similar pixel is adjacent to the lower side of the 
objective pixel . Thus, Step 317 is executed in which a luminance 
valueY, color difference signals Cb and Cr, and amodified luminance 
value YG are obtained using the second R, first G, and second 
B-signals of the first similar pixel . 

The luminance value Y , the color difference signals Cb and 
Cr, and the modified luminance value YG are calculated according 
to the following formulas (5c) , (6c) , (7c) , and (8c) . 
Y=0.299 x R(x,y+l)+0.587 x G (x,y+l) +0 . 114 x B(x,y+1) (5c) 
Cb=-0.169 x R(x,y+1) -0.331 x G(x,y+l)+0.5 x B(x,y+1) (6c) 
Cr=0.5 x R(x,y+1) -0.419 x G (x,y+l) -0 . 081 x B(x,y+1) (7c) 
YG=Y x G(x,y)/G(x,y+1) (8c) 

Then, in ways similar to those in Steps 311, 314, and 316, 
Step 312 is executed in which the second G-signal of the objective 
pixel is modified according to formula (9) , a third B-signal of 
the objective pixel is calculated according to the formula (10) , 
and the first interpolation/modification process routine ends. 

The first interpolation/modification process routine is 
executed for all of the pixels of the image belonging to the first 
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pattern. When the G-interpolation process routine (Fig. 4) , the 
R/B-interpolation process routine (Fig. 5) , and the first 
interpolation/modification process routine (Figs. 7Aand7B) have 
been completed, the R, G, and B-signals are obtained for the images 
belonging to the first, second, and third patterns ; however, the 
R-signals of the image belonging to the fourth pattern have not 
been obtained yet. 

The R-signals of the image of the fourth pattern are obtained 
by the second interpolation/modification process routine. 
Further , in the second interpolation/modification process routine , 
the second G- signal obtainedby the G-interpolation process routine 
is modified. 

Fig. 8 is the latter part of a flowchart of the second 
interpolation/modification process routine. Note that, since the 
initial part of the flowchart is identical to that of the first 
interpolation/modification process routine shown in Fig. 7A, 
excepting that the pixel having the first G-signal , which is 
determined in the second interpolation/modification process 
routine to have the closest luminance to the second G-signal of 
the objective pixel, is referred to as a second similar pixel, 
the initial part is omitted. Pixels utilized in the second 
interpolation/modification process routine are contained in the 
images belonging to the second and third patterns . 

The contents of Steps 410, 413, and 415 are the same as those 
of Steps 310, 313, and 315 (Fig. 7B) . The contents of Steps 411, 
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414, 416, and 417 are the same as those of Steps 311, 314, 316, 
and 317. 

In Step 412, a third R-signal r of the objective pixel is 
calculated according to the formula (11) , which is equivalent to 
5 an interpolation process. Further, the second G-signal of the 
objective pixel is modified according to the formula (12) , so that 
a modified G-signal g f is obtained. 

r=YG+1.402 x Cr (11) 
g'=YG-0.344 x Cb-0.714 x Cr (12) 

f~i 10 The second interpolation/modification process routine is 

In executed for all of the pixels of the image belonging to the fourth 

vLJ pattern . 

Thus, in the second interpolation/modification process 

r7 routine, in a similar way as in the first 

ru 

nj 15 interpolation/modification process routine, the third R-signal 
f|J of the objective pixel is obtained by interpolation , and the second 

G-signal is modified, by supposing that the color difference 
signals Cb and Cr of the objective pixel are equal to the color 
difference signals Cb and Cr of a second similar pixel, and by 
20 deeming the modified luminance value YG to be the luminance value 
of the ob j ective pixel . 

As described above, in the first interpolation/modification 
process routine (Figs. 7A and 7B) and the second 
interpolation/modification process routine (Fig. 8), a pixel, 
25 which has the closest luminance value to the objective pixel, is 
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extracted from pixels positioned at the left, right, upper, and 
lower sides of the objective pixel, so that the interpolation 
process is performed, in the first embodiment. The correlation 
of colors of two pixels becomes great as the luminance values of 
5 the two pixels become close to each other. Accordingly, in the 
interpolation process , the color difference signals of the similar 
pixel are set to the color difference signals of the objective 
pixel, so that a pixel signal having a closer color to the actual 
color of the objective pixel can be obtained. Therefore, according 

10 to the first embodiment, the chromatic blur occurring in a 
reproduced image can be reduced. 

Further, in the first embodiment, since the second G-signal 
obtained by the G-interpolation process routine is modified 
according to the formulas (9) and (12) , the hue or color of the 

15 objective pixel becomes close to that of the pixels positioned 
around it, which reduces the color blur in the whole image. 

With reference to Figs. 9 and 10, a second embodiment is 
described below. Fig. 9 is the initial part of a flowchart of 
the first interpolation /modification process routine of the second 

20 embodiment. Fig. 10 is the initial part of a flowchart of the 
second interpolation/modification process routine of the second 
embodiment. The other constructions are the same as those of the 
first embodiment, and the explanation thereof is omitted. 

In Step 501, it is determined whether the following 

25 inequality (13) is established. The inequality compares 



luminance values of pixels positioned adjacent to the left and 
right sides of the objective pixel with the luminance value of 
the objective pixel. 

10.587 x (G(x-l,y) -G(x,y) )+0.299 x (R(x-l,y) -R(x,y)) |< 
5 10.587 x (G(x+l,y) -G(x,y) )+0.299 x (R(x+1 ,y) -R(x,y) ) | (13) 
When an inequality (13) exists, i.e., when the luminance value 
of the left side pixel is closer to the luminance value of the 
objective pixel, Step 502 is executed in which a parameter p is 
set to -1. Conversely, when an inequality (13) does not exist, 
10 i.e. , when the luminance value of the right side pixel is closer 
to the luminance value of the objective pixel, or when the left 
side of the inequality (13) is equal to the right side of that, 
Step 503 is executed in which a parameter p is set to 1. 

In Step 504 , it is determined whether the following 
15 inequality (14) is established, which compares luminance values 
of pixels positioned adjacent to the upper and lower sides of the 
objective pixel with a luminance value of the objective pixel. 
10.587 x (G(x,y-1) -G(x,y) )+0.299 x (R(x,y-1) -R(x,y) ) |< 
10.587 x (G(x,y+1) -G(x,y) )+0.299 x (R(x,y+1) -R(x,y) ) | (14) 
20 When an inequality (14) exists, i.e., when the luminance value 
of the upper side pixel is closer to the luminance value df the 
objective pixel, Step 505 is executed in which a parameter q is 
set to -1. Conversely, when an inequality (14) does not exist, 
i.e., when the luminance value of the lower side pixel is closer 
25 to the luminance value of the objective pixel, or when the left 



side of the inequality (14) is equal to the right side of that, 
Step 506 is executed in which a parameter q is set to 1. 

In Step 507, regarding a pixel adjacent to the right or left 
side of the objective pixel , a pixel adjacent to the upper or lower 
5 side of the ob j ective pixel , and the ob j ective pixel , the luminance 
values are compared according to the following inequality (15) . 
10.587 x <G(x+p,y) -G(x,y) )+0.299 x (R (x+p ,y) -R (x,y) ) |< 
10.587 x (G(x,y+q)-G(x,y) )+0.299 x (R (x,y+q) -R (x,y) ) | (15) 
When both of the parameters p and q are -1, and the inequality 

10 (15) is true, the luminance value of the left side pixel is the 
closest to the luminance value of the objective pixel, so that 
Step 508 is executed in which a parameter s is set to p, i.e., 
-1. Conversely, when the inequality (15) does not exist, i.e., 
when the luminance value of the upper side pixel is closer to the 

15 luminance value of the objective pixel, or when the left side of 
the inequality (15) is equal to the right side of that, Step 509 
is executed in which the parameter s is set to 2 x q, i.e., -2. 

When both of the parameters p and q are 1 , when the parameters 
p and q are -1 and 1, or when the parameters p and q are 1 and 

20 -1, Step 507 and Step 508 or 509 are executed in a similar way 
as the above. Thus, in the first interpolation/modification 
process routine, the second G-signal and first R-signal of the 
objective pixel, and the first G-signals and second R-signals of 
the adjacent pixels contained in images belonging to the second 

25 and third patterns are used to check the luminance values . As 
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a result, if the luminance value of the left side pixel is the 
closest, the parameter s is set to -1. If the luminance value 
of the right side pixel is the closest, the parameter s is set 
to 1 , if the luminance value of the upper side pixel is the closest, 
5 the parameter s is set to -2, and if the luminance value of the 
lower side pixel is the closest, the parameter s is set to 2. 

Thus, after the first similar pixel having the closest 
luminance value to that of the objective pixel is extracted, the 
luminance value Y, the color difference signals Cb and Cr, and 
O 10 a modified luminance value YG are obtained using the second R, 
Ifl first G, and second B-signals of the first similar pixel, in 

vy accordance with a process similar to the flowchart shown in Fig. 

7B, so that a third B-signal of the objective pixel is obtained, 

il and the second G-signal is modified. Note that the modified 

FU 

fU 15 luminance value YG is obtained according to the following formula 

O 

fU (16) , using the G-signal s and R-signals of the objective pixel 

and the first similar pixel . The other formulas are the same as 
those of the first embodiment. 
YG=Y x 

20 (0. 587 xG (x, y) +0. 299xR(x, y) )/ (0.587 xG(x' ,y » ) +0 . 299 xR(x » ,y') ) 

(16) 

wherein G(x' ,y') indicates the first G-signal of the similar pixel 
and R(x' ,y*) indicates the second R-signal of the similar pixel. 

In the second interpolation/modification process routine 
25 (Fig. 10) , a third R-signal of the fourth pattern is obtained, 



and the second G-signal is modified. In Step 601 , it is determined 
whether the following inequality (17) , which compares luminance 
values of pixels positioned adjacent to the left and right sides 
of the objective pixel with a luminance value of the objective 
5 pixel, is established. 

10.587 x (G(x-l,y)-G(x,y))+0.114 x (B(x-l,y) -B(x,y)) |< 
10.587 x (G(x+l,y) -G(x,y) ) +0.114 x (B (x+1 ,y) -B (x, y) ) | (17) 
When an inequality (17) exists, Step 602 is executed in which a 
parameter p is set to -1, and when an inequality (17) does not 

p 10 exist, Step 603 is executed in which a parameter p is set to 1. 

Q 

In Step 604, it is determined whether the following 

O 

inequality (18) is established. This inequality compares 

I luminance values of pixels positioned adjacent to the upper and 

C3 

* f * lower sides of the objective pixel with a luminance value of the 

ru 

fU 15 objective pixel. 

Q 

fU |0.587 x (G(x,y-1) -G(x,y) )+0.114 x (B (x,y-l) -B (x,y) ) |< 

10.587 x (G(x,y+1) -G(x,y) )+0.114 x (B (x,y+l) -B (x,y) ) | (18) 
When an inequality (18) exists, Step 605 is executed in which a 
parameter q is set to -1, and when an inequality (18) does not 
20 exist, Step 606 is executed in which a parameter q is set to 1. 

In Step 607, regarding a pixel adjacent to the right or left 
side of the objective pixel , a pixel adjacent to the upper or lower 
side of the objective pixel , and the objective pixel , the luminance 
values are compared according to the following inequality (19) . 
25 |0.587 x (G(x+p,y) -G(x,y) )+0.114 x (B (x+p,y) -B (x, y) ) |< 
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10.587 x (G(x,y+q) -G(x,y) )+0.114 x (B (x,y+q) -B (x,y) ) | (19) 
When both of the parameters p and q are -1, and an inequality (19) 
exists, the luminance value of the left side pixel is the closest 
to the luminance value of the objective pixel, so that Step 608 
5 is executed in which the parameter s is set to p, i.e., -1. 
Conversely, when an inequality (19) does not exist, i.e., when 
the luminance value of the upper side pixel is closer or equal 
to the luminance value of the objective pixel , Step 609 is executed 
in which the parameter s is set to 2 x q, i.e., -2. 

U 

p 10 When both of the parameters p and q are 1 , when the parameters 

5 

Lf! p and q are -1 and 1, or when the parameters p and q are 1 and 

o 



-1, Step 607 and Step 608 or 609 are executed in a similar way 
as the above. Thus, in the second interpolation/modification 

n 

l" & process routine, the second G-signal and first B-signal of the 

ru 

?U 15 objective pixel, and the first G-signals and second B-signals of 

n 

fU the adjacent pixels contained in images belonging to the second 

and third patterns are used to check the luminance values. As 
a result, if the luminance value of the left side pixel is the 
closest, the parameter s is set to -1. If the luminance value 

20 of the right side pixel is the closest, the parameter s is set 
to 1 , if the luminance value of the upper side pixel is the closest, 
the parameter s is set to -2, and if the luminance value of the 
lower side pixel is the closest, the parameter s is set to 2. 

Thus, after the second similar pixel having the closest 

25 luminance value to that of the objective pixel is extracted, the 
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luminance value Y, the color difference signals Cb and Cr, and 
a modified luminance value YG are obtained using the second R, 
first G, and second B-signals of the first similar pixel, in 
accordance with a process similar to the flowchart shown in Fig. 
5 8, so that a third R-signal of the objective pixel is obtained, 
and the second G-signal is modified. Note that the modified 
luminance value YG is obtained according to the following formula 
(20) , using the G-signals and B-signals of the objective pixel 
and the first similar pixel. 
10 YG=Y x 

(0. 587 xG(x,y)+0. 114 xB (x, y) )/ (0.587 xG(x' ,y ' ) +0 . 114 xB (x' ,y') ) 

(20) 

wherein G (x • ,y * ) indicates the first G-signal of the similar pixel 
and B(x' ,y') indicates the second B-signal of the similar pixel. 

15 According to the second embodiment, since the first G-signal 

and the second R-signal or the second B-signal are used as the 
luminance value in the first interpolation/modification process 
routine (Fig. 9) and the second interpolation/modification process 
routine (Fig. 10) , the luminance signal can be checked with a high 

20 accuracy. Therefore , the chromatic blur occurring in a reproduced 
image can be further reduced compared to the first embodiment. 

With reference to Figs. 11 and 12, a third embodiment is 
described below. Fig. 11 is the latter part of a flowchart of 
the first interpolation/modification process routine of the third 

25 embodiment. The initial part of the flowchart is identical with 



that shown in Fig. 7A. Fig. 12 is the latter part of a flowchart 
of the second interpolation/modification process routine of the 
third embodiment. The initial part of the flowchart is identical 
with that shown in Fig. 7A. The other constructions are the same 
as those of the first embodiment, and the explanation thereof is 
omi tted . 

In Step 710, it is determined whether the parameter s is 
-1, i.e. , whether the first similar pixel is adjacent to the left 
side of the objective pixel. When the parameter s is -1, Step 
711 is executed in which color difference signals Cb and Cr are 
obtained using R(x-l,y), G(x-l,y), and B(x-l,y) which are the 
second R, first G, and second B-signals of the first similar pixel . 

The color difference signals Cb and Cr are calculated 
according to the following formulas (21) and (22) . 
Cb=-0.169 x R(x-l,y)-0.331 x G(x-l,y)+0.5 x B(x-l,y) (21) 
Cr=0.5 x R(x-l,y) -0.419 x G (x-1 ,y) -0 . 081 x B(x-l,y) (22) 

The formulas (21) and (22) are known. 

In Step 712, the second G-signal of the objective pixel is 
calculated or modified according to the formula (23) , so that a 
modified G-signal g' is obtained. Further, a third B- signal of 
the objective signal is calculated according to the formula (24) , 
which is equivalent to an interpolation process. Thus, the first 
interpolation/modification process routine ends. 
g'=1.443 x R(x,y)+0.443 x Cb-2 . 737 x Cr (23) 
b=1.293 x R(x,y)+2.293 x Cb-1.812 x Cr (24) 
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In the formulas (23) and (24) , R(x,y) is the first R-signal 
of the objective pixel. 

Thus, in the third embodiment, the third B-signal of the 
objective pixel is obtained by interpolation, and the second 
5 G-signal is modified, supposing that the color difference signals 
Cb and Cr of the objective pixel are equal to the color difference 
signals Cb and Cr of the first similar pixel . 

When it is determined in Step 710 that the parameter s is 
not -1, the process goes to Step 713 in which it is determined 

p 10 whether the parameter s is 1 , i . e . , whether the first similar pixel 

O 

if! is adjacent to the right side of the objective pixel. When the 

O 

y-i parameter s is 1, Step 714 is executed in which color difference 
signals Cb and Cr are obtained using the second R, first G, and 

12 second B-signals of the first similar pixel. 

f.y 15 The color difference signals Cb and Cr are calculated 

g 

FU according to the following formulas (21a) and (22a) . 

Cb=-0.169 x R(x+l,y) -0.331 x G(x+l,y)+0.5 x B(x+l,y) (21a) 
Cr=0.5 x R(x+l,y) -0.419 x G (x+1 ,y) -0 . 081 x B(x+l,y) (22a) 
Step 712 is then executed. Namely, the second G-signal of 
20 the objective pixel is modified according to the formula (23) , 
so that a modified G-signal g' is obtained. Further, a third 
B-signal of the objective signal is calculated according to the 
formula (24) . Thus , the first interpolation/modification process 
routine ends. 

25 When it is determined in Step 713 that the parameter s is 
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not 1 , the process goes to Step 715 in which it is determined whether 
the parameter s is -2, i.e., whether the first similar pixel is 
adjacent to the upper side of the objective pixel. When the 
parameter s is -2, Step 716 is executed in which color difference 
signals Cb and Cr are obtained using the second R, first G, and 
second B-signals of the first similar pixel. 

The color difference signals Cb and Cr are calculated 
according to the following formulas (21b) and (22b) . 
Cb=-0.169 x R(x,y-1) -0.331 x G(x,y-l)+0.5 x B(x / y-l) (21b) 
Cr=0.5 x R(x,y-1) -0.419 x G (x,y-l) -0 . 081 x B(x,y-1) (22b) 

Then, in ways similar to those in Steps 711 and 714, Step 
712 is executed in which the second G-signal of the objective pixel 
is modified according to the formula (23) , a third B-signal of 
the objective pixel is calculated according to the formula (24) , 
and the first interpolation/modification process routine ends. 

When it is determined in Step 715 that the parameter s is 
not -2, it is deemed that the parameter is 2, i.e. , it is deemed 
that the first similar pixel is adjacent to the lower side of the 
objective pixel. Thus, Step 717 is executed in which color 
difference signals Cb and Cr are obtained using the second R, first 
G, and second B-signals of the first similar pixel. 

The color difference signals Cb and Cr are calculated 
according to the following formulas (21c) and (22c) . 
Cb=-0.169 x R(x,y+1) -0.331 x G(x,y+l)+0.5 x B(x,y+1) (21c) 
Cr=0.5 x R(x,y+1) -0.419 x G (x,y+l) -0 . 081 x B(x,y+1) (22c) 
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Then, in ways similar to those in Steps 711, 714, and 716, 
Step 712 is executed in which the second G-signal of the objective 
pixel is modified according to the formula (23) , a third B-signal 
of the objective pixel is calculated according to the formula (24) , 
and the first interpolation/modification process routine ends. 

The first interpolation/modification process routine is 
executed for all of the pixels of the image belonging to the first 
pattern. When the G-interpolation process routine (Fig. 4) , the 
R/B-interpolation process routine (Fig. 5) , and the first 
interpolation/modification process routine (Figs. 7Aandll) have 
been completed, the R, G, and B-signals are obtained for the images 
belonging to the first, second, and third patterns ; however, the 
R-signals of the image belonging to the fourth pattern have not 
been obtained yet. 

The R-signals of the image of the fourth pattern are obtained 
by using the second interpolation/modification process routine. 
Further, in the second interpolation/modification process routine, 
the second G-signal obtainedby the G-interpolation process routine 
is modified. Fig. 12 is the latter part of a flowchart of the 
secondinterpolation/modif ication process routine . Note that the 
initial part of the flowchart is identical to that of the first 
interpolation/modification process routine shown in Fig. 7A, 
excepting that the extracted similar pixel is defined as the second 
similar pixel . 

The contents of Steps 810, 811 , 813 through 817 are identical 
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with those in Steps 710, 711, 713 through 717 (Fig. 11). 

In Step 812, a third R-signal r of the objective pixel is 
calculated according to the formula (25) , which is equivalent to 
an interpolation process. Further, the second G-signal of the 
objective pixel is calculated or modified according to the formula 
(26) , so that a modified G-signal g' is obtained. 
r=0.773 x B(x,y) -1.773 x Cb+1.401 x Cr (25) 
g'=1.116 x B(x,y) -2.116 x Cb-0.715 x Cr (26) 

The second interpolation/modification process routine is 
executed for all of the pixels of the image belonging to the fourth 
pattern . 

Thus, in the second interpolation /modification process 
routine, the third R-signal of the objective pixel is obtained 
by interpolation, and the second G-signal is modified, supposing 
that the color difference signals Cb and Cr of the objective pixel 
are equal to the color difference signals Cb and Cr of the second 
similar pixel, in a similar way to the first 
interpolation/modification process routine. 

As described above , in the third embodiment, a similar pixel , 
which has the closest luminance value to that of the objective 
pixel, is extracted from pixels adjacent to the objective pixel, 
and an interpolation process is then performed, in the first 
interpolation/modification process routine and the second 
interpolation/modification process routine. Therefore, 
according to the third embodiment, the chromatic blur occurring 
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in a reproduced image can be reduced, similarly to the first and 
second embodiments . 

Further, according to the third embodiment, the second 
G-signal obtained in the G-interpolation process routine is 
5 modified according to the formulas (23) and (26) . Accordingly, 
the hue or color of the objective pixel becomes close to that of 
the pixels positioned around the objective pixel, which further 
reduces the color blur in the whole image. 

A fourth embodiment is obtained in such a manner that the 

jh 10 initial parts of the flowcharts of the first 

Q 

Ifl interpolation/modification process routine and the second 

O 

interpolation/modification process routine of the third 
embodiment are replaced by those shown in Figs. 9 and 10, instead 

rf of the one shown in Fig. 7A. Namely, the first 

ru 

fy 15 interpolation/modification process routine is obtained by 

o 

FU combining Figs . 9 and 11 , and the second interpolation/modification 

process routine is obtained by combining Figs. 10 and 12. 

According to the fourth embodiment, since the first 
G-signal and the second R-signal or the second B-signal are used 
20 as the luminance value in the first interpolation/modification 
process routine (Fig. 9) and the second interpolation/modification 
process routine (Fig. 10) , the luminance signal can be checked 
with a high accuracy. Therefore, the chromatic blur occurring 
in a reproduced image can be further reduced compared to the third 
2 5 embodimen t . 
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Although the embodiments of the present invention have 
been described herein with reference to the accompanying 
drawings, obviously many modifications and changes may be made 
by those skilled in this art without departing from the scope 
of the invention. 

The present disclosure relates to subject matter 
contained in Japanese Patent Application No. 2001-018044 
(filed on January 26, 2001) and No. 2001-030656 (filed on 
February 7, 2001) which are expressly incorporated herein, 
by reference, in their entireties. 



37 



